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DETAILED ACTION 

This communication is responsive to amendments filed 09/15/2009. Claims 1- 
11, and 24 are cancelled. Claims 12, 13, and 23 are amended. Currently claims 12-23 
are pending. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 12-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ghercioiu et al. (US 2004/0010734) in view of Hasako et al. (US 2003/0093715), and 
further in view of Keele et al. (US 2005/0086695). 

In reference to claim 12, Ghercioiu teaches a display apparatus comprising 
(Ghercioiu, pg. 1, par. 10): 

storage means for storing a control program having a plurality of instructions and 
each symbol data for displaying a symbol related to each of said plurality of instructions 
(Ghercioiu, pg. 14, par. 233); 
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control means for controlling control target equipment electrically connected to 
said display apparatus by executing each of said plurality of instructions (Ghercioiu, pg. 
1,par. 7); 

display means for displaying an image (Ghercioiu, pg. 2, par. 12); 

first display control means based on the symbol data corresponding to the 
instruction executed by said control means for causing the symbol corresponding to 
said executed instruction to be displayed in a first display region in said display means 
(Ghercioiu, pg. 1, par. 7); 

video signal input means for receiving an input of video data generated based on 
a picked-up image of said control target equipment (Ghercioiu, pg. 7, par. 80); 

video data storing means for storing said video data (Ghercioiu, pg. 7, par. 80); 

detection means for detecting designation of the symbol displayed in said first 
display region (Ghercioiu, pg. 14, par. 233). 

Ghercioiu however fails to teach a relation means for relating the symbol data 
corresponding to the instruction executed by said control means to the video data 
stored in said video data storing means; and second display control means responsive 
to detection of said designation for causing a moving image to be displayed in a second 
display region in said display means based on the video data related to the symbol data 
corresponding to the symbol displayed in said first display region. 

Hasal<o discloses a display apparatus, analogous in art with that of Ghercioiu, 
comprising a relation means for relating the symbol data corresponding to the 
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instruction executed by said control means to the video data stored in said video data 
storing means (Hasako, pg. 1, par. 15-17; pg. 17, par. 376); 

and second display control means responsive to detection of said designation for 
causing a moving image to be displayed in a second display region in said display 
means based on the video data related to the symbol data corresponding to the symbol 
displayed in said first display region (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that there is a 
relation means for relating the symbol data corresponding to the instruction executed by 
said control means to the video data stored in said video data storing means; and 
second display control means responsive to detection of said designation for causing a 
moving image to be displayed in a second display region in said display means based 
on the video data related to the symbol data corresponding to the symbol displayed in 
said first display region, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Ghercioiu modified by Hasako however fails to teach wherein the control means 
displays the moving image of at least one of a time period from a predetermined time 
previous to said detection and a time period to a predetermined time after said 
detection. 
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Keele discloses a display system comprising event detection, analogous in art 
with that of Ghercioiu modified by Hasako, wherein the control means displays the 
moving image of at least one of a time period from a predetermined time previous to 
said detection and a time period to a predetermined time after said detection (Keele, pg. 

10, par. 143). 

At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako 
wherein the control means displays the moving image of at least one of a time period 
from a predetermined time previous to said detection and a time period to a 
predetermined time after said detection, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 13 is rejected as being dependent on rejected claim 12 as discussed 
above and further, Ghercioiu fails to teach further comprising: timer means for 
measuring a time, wherein said relation means relates the symbol data corresponding 
to the symbol displayed in said first display region to the video data input through said 
video signal input means based on the time measured by said timer means. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
further comprising timer means for measuring a time, wherein said relation means 
relates the symbol data corresponding to the symbol displayed in said first display 
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region to the video data input tlirougin said video signal input means based on the time 
measured by said timer means (Hasako, pg. 17, par. 397-399). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that it further 
comprises timer means for measuring a time, wherein said relation means relates the 
symbol data corresponding to the symbol displayed in said first display region to the 
video data input through said video signal input means based on the time measured by 
said timer means, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 14 is rejected as being dependent on rejected claim 13 as discussed 
above and further, Ghercioiu as modified by Hasako teaches further comprising: state 
signal input means for receiving an input of a state signal indicating a state of said 
control target equipment (Ghercioiu, pg. 14, par. 233); 

log generation means for generating log information representing history of an 
operation of said control target equipment based on said time and said state signal 
(Ghercioiu, pg. 14, par. 233); 

and log storing means for storing said log information (Ghercioiu, pg. 14, par. 

233), 
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wherein said relation means relates the symbol data corresponding to the 
symbol displayed in said first display region to said log information (Hasako, pg. 17, par. 
397-399). 

Claim 15 is rejected as being dependent on rejected claim 14 as discussed 
above and further, Ghercioiu modified by Hasako teaches wherein said state signal 
input means receives an input of a signal indicating an abnormality in said control target 
equipment (Ghercioiu, pg. 14, par. 233); 

said log generation means generates log information indicating an abnormality in 
said control target equipment when said signal indicating an abnormality is input 
(Ghercioiu, pg. 14, par. 233); 

said relation means relates a time at which said log information indicating an 
abnormality is generated to said log information indicating an abnormality for storage in 
said log storing means (Hasako, Fig. 13a; pg. 17, par. 376), 

and said first display control means causes the symbol to be displayed in said 
first display region by making a difference between an output form of the symbol data 
for displaying the symbol corresponding said log information indicating an abnormality 
and an output form of the symbol data for displaying the symbol corresponding to a 
normal state in said control target equipment, so that a first display manner in said 
display means of the symbol corresponding to said log information indicating an 
abnormality differs from a second display manner in said display means of the symbol 
corresponding to said normal state (Ghercioiu, pg. 14, par. 233). 
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Claim 16 Is rejected as being dependent on rejected claim 15 as discussed 
above and further, Ghercioiu teaches wherein said detection means detects designation 
of the symbol displayed in said first display manner (Ghercioiu, pg. 14, par. 233). 

Ghercioiu however fails to teach said display apparatus further comprising: 
reading means for reading time corresponding to said log information indicating an 
abnormality from said log storing means based on detection of said designation. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
further comprising: reading means for reading time corresponding to said log 
Information indicating an abnormality from said log stohng means based on detection of 
said designation (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill In the art to modify the display apparatus of Ghercioiu such that there Is a 
reading means for reading time corresponding to said log information indicating an 
abnormality from said log storing means based on detection of said designation, as 
taught by Hasako. 

As one of ordinary skill In the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out Inspection and troubleshooting of a process In 
sync with a displayed video image of the process. 

Ghercioiu modified by Hasako however fails to teach a reproduction means for 
reading video data corresponding to a predetermined period of time from said read time. 
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wherein said second display control means causes a moving image to be displayed in 
said second display region based on the video data read by said reproduction means. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, with a reproduction means for reading video data corresponding 
to a predetermined period of time from said read time (Keele, pg. 10, par. 143), 

wherein said second display control means causes a moving image to be 
displayed in said second display region based on the video data read by said 
reproduction means (Keele, Abstract; pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako such 
that there is a reproduction means for reading video data corresponding to a 
predetermined period of time from said read time, wherein said second display control 
means causes a moving image to be displayed in said second display region based on 
the video data read by said reproduction means, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 17 is rejected as being dependent on rejected claim 16 as discussed 
above and further, Ghercioiu modified by Keele however fails to teach wherein said 
display means displays said first display region and said second display region in the 
same screen. 
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Hasako discloses a display apparatus, analogous in art with tliat of Gliercioiu 
modified by Keele wherein said display means displays said first display region and said 
second display region in the same screen (Hasako, Fig. 13a.). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 18 is rejected as being dependent on rejected claim 15 as discussed 

above and further Ghercioiu modified by Hasako teaches wherein said detection means 
detects designation of the symbol displayed in said first display manner (Ghercioiu, pg. 
14, par. 233), 

said display apparatus further comprising: reading means for reading time 
corresponding to said log information indicating an abnormality from said log storing 
means based on detection of said designation (Ghercioiu, pg. 14, par. 233). 

Ghercioiu modified by Hasako however fails to teach a reproduction means for 
reading video data corresponding to a period of time from predetermined time previous 
to said time to predetermined time subsequent to said time, wherein said second 
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display control means causes a moving image to be displayed in said second display 
region based on the video data read by said reproduction means. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, such that there is a reproduction means for reading video data 
corresponding to a period of time from predetermined time previous to said time to 
predetermined time subsequent to said time (Keele, pg. 10, par. 143), 

wherein said second display control means causes a moving image to be 
displayed in said second display region based on the video data read by said 
reproduction means (Keele, Abstract; pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Hasako 
such that there is a reproduction means for reading video data corresponding to a 
period of time from predetermined time previous to said time to predetermined time 
subsequent to said time, wherein said second display control means causes a moving 
image to be displayed in said second display region based on the video data read by 
said reproduction means, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 19 is rejected as being dependent on rejected claim 18 as discussed 
above and further, Ghercioiu modified by Keele however fails to teach wherein said 
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display means displays said first display region and said second display region in the 
same screen. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu 
modified by Keele wherein said display means displays said first display region and said 
second display region in the same screen (Hasako, Fig. 13a.). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 20 Is rejected as being dependent on rejected claim 15 as discussed 
above and further, Ghercioiu modified by Hasako teaches wherein said first display 
control means controls said display means such that a plurality of symbols are 
displayed in said first display region in said first display manner (Ghercioiu, pg. 14, par. 
233); 

said detection means detects designation of any symbol among said plurality of 
symbols (Ghercioiu, pg. 14, par. 233), 

and said second display control means (Hasako, Fig. 13a; pg. 17, par. 376), 
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includes time data reading means for reading eacli time corresponding to eacli of 
said plurality of symbols from said log storing means (Ghercioiu, pg. 14, par. 233). 

Ghercioiu as modified by Hasako above does not expressly disclose video data 
reading means for reading video data corresponding to a predetermined period of time 
from said read each time for each of said plurality of symbols from said log storing 
means. 

However, Hasako additionally teaches a display apparatus, analogous in art with 
that of Ghercioiu such that there is a reading means for reading video data 
corresponding to a predetermined period of time from said read each time for each of 
said plurality of symbols from said log storing means (Hasako, pg. 1 , par. 15-17; pg. 17, 
par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to further modify the display apparatus of Ghercioiu in view of 
Hasako above wherein there is a reading means for reading video data corresponding 
to a predetermined period of time from said read each time for each of said plurality of 
symbols from said log storing means, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Ghercioiu as modified by Hasako does not expressly disclose a reproduction 
control means for causing a moving image to be displayed in said second display region 
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in time order or backward in time from said time corresponding to any symbol of whicli 
said designation is detected based on said read video data. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, such that there is a reproduction control means for causing a 
moving image to be displayed in said second display region in time order or backward in 
time from said time corresponding to any symbol of which said designation is detected 
based on said read video data (Keele, pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Hasako 
such that there is a reproduction means for reading video data corresponding to a 
period of time from predetermined time previous to said time to predetermined time 
subsequent to said time, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 21 is rejected as being dependent on rejected claim 20 as discussed 
above and further, Ghercioiu as modified above by Hasako and further in view of Keele 
does not expressly disclose wherein said display means displays said first display 
region and said second display region in the same screen. 
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However, Hasako additionally teaches a display apparatus, analogous in art with 
that of Ghercioiu in view of Keele wherein said display means displays said first display 
region and said second display region in the same screen (Hasako, Fig. 13a.)- 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu in view of Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 22 is rejected as being dependent on rejected claim 12 as discussed 

above and further, Ghercioiu modified by Hasako teaches wherein said video signal 
input means receives an input of each video data generated based on an image of said 
control target equipment picked up by each of a plurality of image picking-up means 
(Ghercioiu, pg. 7, par. 80), 

said relation means relates each symbol data corresponding to each of a plurality 
of instructions executed by said control means to said each video data and said second 
display control means causes each moving image to be displayed in said second 
display region based on said each video data (Hasako, pg. 1, par. 15-17; pg. 17, par. 
376). 
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In reference to claim 23, Gliercioiu teaches a computer-readable recording 
medium storing thereon a program causing a computer to function as a display 
apparatus (Ghercioiu, pg. 14, par. 233), 

said program causing said computer to execute the steps of: reading a control 
program having a plurality of instructions and each symbol data for displaying a symbol 
related to each of said plurality of instructions from storage means for storing data 
(Ghercioiu, pg. 14, par. 233), 

controlling control target equipment electrically connected to said computer by 
executing each of said plurality of instructions (Ghercioiu, pg. 1, par. 7); 

based on the symbol data corresponding to the instruction executed at said 
controlling step (Ghercioiu, pg. 1, par. 7); 

causing the symbol corresponding to said executed instruction to be displayed in 
a first display region in display means for displaying an image (Ghercioiu, pg. 1 , par. 7); 

receiving an input of video data generated based on a picked-up image of said 
control target equipment (Ghercioiu, pg. 7, par. 80); 

storing said video data in said storage means (Ghercioiu, pg. 7, par. 80); 

detecting designation of the symbol displayed in said first display means 
(Ghercioiu, pg. 14, par. 233). 

Ghercioiu however fails to teach relating the symbol data corresponding to said 
executed instruction to said video data; and in response to detection of said 
designation, causing a moving image to be displayed in a second display region in said 
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display means based on tlie video data related to the symbol data corresponding to the 
symbol displayed in said first display region. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
relating the symbol data corresponding to said executed instruction to said video data 
(Hasako, pg. 1, par. 15-17; pg. 17, par. 376); 

and in response to detection of said designation, causing a moving image to be 
displayed in a second display region in said display means based on the video data 
related to the symbol data corresponding to the symbol displayed in said first display 
region (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that there is a 
relation means for relating the symbol data corresponding to the instruction executed by 
said control means to the video data stored in said video data storing means; and 
second display control means responsive to detection of said designation for causing a 
moving image to be displayed in a second display region in said display means based 
on the video data related to the symbol data corresponding to the symbol displayed in 
said first display region, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 
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Ghercioiu modified by Hasal<o liowever fails to teach wherein a display region 
displays the moving image during a period of at least one of prior to and after said 
detection. 

Keele discloses a display system comprising event detection, analogous in art 

with that of Ghercioiu modified by Hasako, wherein a display region displays the moving 
image during a period of at least one of prior to and after said detection (Keele, pg. 1 0, 
par. 143). 

At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako 
wherein a display region displays the moving image during a period of at least one of 
prior to and after said detection, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Response to Arguments 

Applicant's arguments filed 09/15/2009 have been fully considered but they are 
not persuasive. 

As to claim 1 on page 12 of applicant's response, applicant argues that Ghercioiu 
merely states in paragraph [0080] that the computer system of Fig. 3 has a "video 
display subsystem", and does not disclose or suggest "video signal means for receiving 
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an input of video data generated based on a picked-up image of said control target 
equipment". 

Ghercioiu teaches a video input of data generated based on control target 
equipment (Ghercioiu, Fig. 3, pg. 7, par. 80-81; pg. 2, par. 14). 

Ghercioiu teaches that a graphical program or block diagram are each intended 
to include a plurality of interconnected nodes or icons which visually indicate the 
functionality of the program. Further, Ghercioiu teaches that input data to the graphical 
program may be received from any of various sources, such as a device including a 
video display subsystem. 

Therefore, Ghercioiu teaches video signal means for receiving an input of video 
data generated based on a picked-up image of said control target equipment. 

Applicants further argue on page 12 of applicants response that Hasako merely 
discloses superimposing the inspection result image data on the test video data, and 
does not display "the moving image of at least one of a time period from a 
predetermined time previous to said detection and a time period to a predetermined 
time after said detection", as recited in amended claim 12. 

Keele teaches displaying an image based on a predetermined time (Keele, pg. 
10, par. 143). 

Keele teaches a display system comprising event detection with controls 
provided to the user to specify the start and end time of a content block. 
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Therefore, Keele teaches the moving image of at least one of a time period from 
a predetermined time previous to said detection and a time period to a predetermined 
time after said detection. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHARLES HICKS whose telephone number is 571-270- 
7535. The examiner can normally be reached on Monday-Thursday from 7:30 to 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Sumati Lefkowitz, can be reached on 571-272-3638. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



/Sumati Lefkowitz/ 

Supervisory Patent Examiner, Art Unit 2629 



